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Abstract 

We solve the problem of designing powerful low-density parity-check (LDPC) codes with itera- 
tive decoding for the block-fading channel. We first study the case of maximum-likelihood decoding, 
and show that the design criterion is rather straightforward. Unfortimately, optimal constructions for 
maximum-likelihood decoding do not perform well under iterative decoding. To overcome this limitation, 
we then introduce a new family of full-diversity LDPC codes that exhibit near-outage-Umit performance 
under iterative decoding for all block-lengths. This family competes with multiplexed parallel turbo codes 
suitable for nonergodic channels and recently reported in the Uterature. 
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I. Introduction 

The block-fading (BF) channel model was first introduced in [16], and further elaborated upon 
in [2] (see also [1, p. 98 ff.]). This is a realistic and convenient model for a number of channels 
affected by slowly varying fading, and, as observed for example in [6], is especially relevant 
in wireless communications involving slow time-frequency hopping (e.g., cellular networks and 
wireless Ethernet) or multicarrier modulation using orthogonal frequency division multiplexing 
(OFDM). The design of error-control codes for BF channels offers a challenging problem, 
which differs greatly from its counterparts referred to additive white Gaussian noise (AWGN) or 
independent-fading channels (see [6] for a summary of recent results). The main reason for this 
unlikeness stems from the fact that in BF channels the random channel gains remain constant 
during a block of symbols (see below for additional details and definitions), and take independent 
values from block to block. As a result, while the word-error probability in independent-fading 
channels depends on the Hamming distances between code words, in BF channels it depends 
on a new parameter, the blockwise Hamming distance. Since codes exhibiting a large minimum 
Hamming distance may not have a large blockwise Hamming distance, codes that are good 
when used on the independent-fading channel may not be as good for a BF channel. In addition, 
over independently faded channels permutations of the symbols cause no variation of the code 
performance, but this property does not hold on the BF channel. Thus, if an off-the-shelf code, 
designed for the independent-fading channel, is used for transmission over the BF channel, it 
is important to carefully select the best permutation of its symbols. Finally, one must consider 
that the BF channel is nonergodic. As a consequence, to determine the information-theoretical 
rate Umit which cannot be surpassed by the word error probability of any coding scheme, one 
cannot use channel capacity, but rather outage probability [1], [2], [16]. Classical random-like 
codes, designed to approach ergodic capacity, cannot generally approach the ideal performance 
limits of BF channels, and hence code designs suited to the nonergodic nature of the channel 
are called for. This paper is devoted to this design problem. 

Two main parameters that determine the error rate of coded BF channels for high signal- 
to-noise (SNR) ratios are the diversity order and the coding gain. The former determines the 
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slope of the error-rate curve as a function of the SNR on a log-log scaleQ Since the error 
probability of any coding scheme is lower-bounded by the outage probability, the diversity order 
is upper-bounded by the intrinsic diversity of the channel, which reflects the slope of the outage 
limit. When maximum diversity is achieved by a code, the coding gain yields a measure of 
SNR proximity to the outage limit. The maximum achievable diversity order with discrete input 
constellations is given by the Singleton bound [6], [11], [14], and codes achieving the Singleton 
bound are termed blockwise maximum-distance separable (MDS). Blockwise MDS codes are 
outage- achieving over the (noiseless) block-erasure channel [7], but may not achieve the outage- 
probability limit on noisy BF channels. As a matter of fact, as shown in [6], blockwise MDS 
codes are necessary, but not sufficient to approach the outage probability of the channel. 

Recent code designs for BF channels include near-outage schemes based on a suitable permu- 
tation of parallel turbo codes [3]-[5]. Multiplexers for convolutional, turbo and repeat-accumulate 
codes [3], [6], [11] appeared one decade after the analysis of random and periodic interleaving of 
convolutional codes on the block-erasure channel [13]. Random ensembles of low-density parity- 
check codes (LDPC) designed for ergodic AWGN channels [9], [19], in spite of the excellent 
decoding threshold of their irregular structures, do not have full-diversity, and hence exhibit 
a poor performance over a BF channel. Decoding thresholds of LDPC code ensembles over 
ergodic BF channels have been studied [10]. Unfortunately, these codes are not designed to be 
blockwise MDS, and therefore fail to achieve the outage limit in the nonergodic setup. 

In this work, we introduce a new family of blockwise MDS LDPC codes, the root LDPC codes, 
based on a special type of checknode that we call rootchecks. Under iterative message-passing 
decoding, they achieve the outage-probability limit on block-erasure channels, and they perform 
close to that limit on Rayleigh BF channels. This paper is organized as follows. Section [ll] 
introduces the channel model and the relevant notations. LDPC codes with full diversity under 
Maximum Likelihood (ML) decoding are discussed in section [111} Our new family of LDPC codes 
suited for iterative decoding is further described. Section |V] analyzes their density evolution in the 
presence of block fading. Conclusions are finally drawn in Section |Vlj Complementary support 
material is shown in the Appendix. 

'The diversity order is exactly the asymptotic slope for Rayleigh fading, while for other fading distributions it is only 
proportional to the slope. See [15], [22] for details. In this paper we shall restrict our attention to Rayleigh fading. 
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Fig. 1 . Codeword representation for a BF channel with tie — 2. The fading gains ai , 02 are independent between themselves and 
among codewords. 



II. Channel model and notation 

We consider codewords of binary digits transmitted on a BF channel, where independent 
fading gains (whose values form the channel state) affect each codeword. The length is a 
multiple of ric, with ^ = N/ric denoting the number of bits per fading block. The received signal 
when symbol Xi is transmitted is given by 

tji = ajXi + Zi (1) 

where yi E M., i = 1 . . . N , and j = 1 + [(i — l)/£], with [r] denoting the integer part of a 
real number r. The nonnegative real number aj is the fading gain at block j, j = 1 . . . ric. The 
symbols Xj are chosen from a BPSK alphabet, Xj = ±v^, where Eg is the average energy per 
symbol. The noise samples are i.i.d. with Zi ~ A/'(0, cr^), = Nq/2. We assume perfect channel 
state information (CSI) at the receiver, and channel gains which are i.i.d. Rayleigh-distributed 
from block to block and from codeword to codeword. Thus, when the information rate is R bits 
per channel use, the average SNR per symbol is given by 7 = E^/Nq, and the average SNR per 
bit is Eb/No = 7/-R. Fig. [T] illustrates the channel model for Uc = 2 and i = N/2. 

In this work, we focus on linear binary codes C(A^, K)2 with block length N, dimension K, 
and rate R = K/N < l/ric < 1/2. The code C is defined by an L x parity-check matrix 
H (Fig. |2]), or, equivalently, by the corresponding Tanner graph [1]. This has L single-parity 
checknodes. It is assumed that H has full rank L, so that i? = 1 — L/N. 

For a given nonzero codeword c G C, we define the blockwise Hamming weight vector 
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Fig. 2. Parity-check matrix notations for a block-fading channel with ric = 2. The L — N/2 extra rows are added in order to 
enhance the coding gain of a full-diversity code. 



{ui, . . . , UnJ, where ujj is the Hamming weight of the coded bits affected by fading aj. Following 
[6], [11] we define the block diversity of G as 

d — mill I icuj 7^ 0} I . 
cee-{o} ■' ' 

In words, the block diversity is the minimum number of blocks that have non-zero Hamming 
weight, or the blockwise Hamming distance. Qualitatively, this implies that an ML decoder of 
G will be able to decode correctly in presence of d — 1 deep fades, which one can think of as 
block erasures. 

We also define the minimum blockwise Hamming weight as 

a;* = mill {ui, . . . ,Un,). 
cee-{oy 

Definition 1 An error-correcting code is said to have full diversity if cu* > 0. 

Having a;* > implies that d — ric, having nonzero weight in all blocks. 
Now, observe that the blockwise Singleton bound [1], [6], [11], [14] 

d<l + - R)\ 

determines R = l/uc as the highest achievable rate for a full-diversity code. Furthermore, the 
word error probability of a code with diversity Uc decreases as 1/7"'= at high SNR [1], [17], 
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[22]. 

The block-fading channel is not information stable [21], and therefore its Shannon capacity is 
zero since there is a non- vanishing probability that the decoder makes a word error. In the limit 
of large block length, this probability is the information outage probability, defined as [2], [16] 

Pout(7,^)=P{2:(7,«)<i?} (2) 

where X(7, ol) is the instantaneous input-output mutual information between the input and output 
of the channel, defined as 

X(7, a) = —S^ /AWGN(7a?), (3) 

Tic ^ 

1=1 

with /awgnI-s) the input-output mutual information of an AWGN channel with SNR per symbol 
equal to s. The BF channel is also commonly referred to as nonergodic since, for finite values 
of ric, X(7, ol) is a non-constant random variable. 

The information outage probability Pout (7, R) is a fundamental lower bound on the word error 
rate for sufficiently large word length. Therefore, any code approaching Pout (7, -R) should have 
a word-error probability that, as increases, becomes independent of the code length [4], [6]. 

Unless stated otherwise, we shall focus our study on a coding rate P = ^ (or just slightly 
smaller than |) and a nonergodic Rayleigh fading channel with nc = 2 blocks per codeword, as 

However, most of our results can be easily generalized to P = — . 

Tic 

in. Full-diversity LDPC codes under ML decoding 

In this section, we study LDPC codes in the presence of BF under ML decoding. As we shall 
see, the design of full-diversity LDPC codes under ML decoding is rather straightforward. We 
recognize that ML decoding is unfeasible in practice; however, it yields valuable insight into 
code structures suitable for nonergodic channels. The main result of this section is somewhat 
negative: under iterative decoding, ML-designed full-diversity codes fail to guarantee diversity, 
due to badly located pseudo-codewords. 

Following the notations defined in the previous section, the L x N parity-check matrix H is 
written in the form H = [Hi \ H2], where the left and right parts Hi, H2 are L x N/2. The 
vector space generated by the N/2 left columns is denoted Si. Similarly, S2 is the vector space 
generated by the N/2 right columns. 



depicted in Figs, m and 
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Proposition 1 A binary code G with rate R < \, i.e. L > N/2, has full diversity if and only if 
Hi and H2 are both full-rank. 

Proof: If dimiSi = N/2, then a nonzero codeword cannot have its support on Hi, because 
all columns in Hi are independent. Hence, co'2 > for all nonzero codewords. Similarly, ui > 
when dimiS2 = N/2. Finally, cui > and co'2 > for all nonzero codewords, which yields 

uj* >o. m 

The full-rank property of the above proposition was first observed in [8]. Its extension to 
coding rate 1/3 with H = [Hi \ H2 \ H3,] can be obtained by imposing that the matrices 
[Hi I H2], [Hi I H3], and [H2 [ H^] all have full rank. Generalization to any rate R = ^ is 
straightforwarcj^ 

Proposition 2 Consider a binary code G with rate R = 1/2, and hence with L = K = N/ 2. If 
G has full diversity, then uj* = 1. 

Proof: If C has full diversity, then dimiSi = dimiS2 = N/2. Any column from Hi can 
then be written as a linear combination of columns from H2. This is also valid for any column 
belonging to H2. Hence, nonzero codewords with coi = I exist for both i = 1 and i = 2 if the 
coding rate is exactly equal to 1/2. ■ 

The minimum blockwise Hamming weight must be increased in order to improve the coding 
gain of G. Proposition [2] states that to achieve this, one must decrease the coding rate. The next 
proposition shows that adding just one extra row is enough to move from cu* = 1 to to* = 2 
under ML decoding. 

Proposition 3 There exists a binary code G of rate R = 1/2 — 1/N that has full diversity with 
u* = 2. 

Proof: The proof is based on the special parity-check matrix structure shown in Fig. [3] 
where H2 is a full-rank matrix whose columns have odd Hamming weight (the identity matrix, 
for example). Let now Hi be such that its first column is the all zero vector, and the remaining 
N/2 — 1 columns are all even- weight and full-rank. 

^Two interesting combinatorial problems arising from this Proposition are the following: (1) What is the probability of a 
random binary matrix to be full-rank? And, (2) What is the probability of a random binary sparse matrix to be full-rank? 
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Next, we show that the uj* corresponding to this construction is 2. Clearly the first (leftmost) 
N/2 columns of H and the last (rightmost) N/2 columns of H have full rank, so that we have 
UJ* > 1. 

None of the first N/2 columns of H can be a Unear combination of the last N/2 columns of 
H, due to the 1 in the last position of each of the first columns. None of the last N/2 columns 
of H can be a linear combination of the first N/2 columns of H, because columns of H2 have 
odd weight and any linear combination of columns of has even weight. 

These last statements imply that u* >2. ■ 
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Fig. 3. ML-designed full-diversity LDPC code withuj* = 2. 



The rate reduction necessary to achieve u* = 2 is negligible for large code length N. If we 
now require co* — 3, the following result holds: 

Proposition 4 Consider a binary code C with rate R < 1/2. The code has a;* = 3 only if 
i?<l/2-(l/iV)log2(l + iV/2). 

Proof: Denote by H^"^ the set of columns of H2. Consider the 1 + N/2 sets consisting of 
together with its translates hi + for all columns hi of Hi. No two of these sets can 
intersect, otherwise either a column of i/i, or a sum of two columns of Hi, equals a sum of 
columns of H2, which would imply the existence of a codeword of weight at most 2 on the first 
N/2 positions. Therefore we must have 2^ > (1 + N/2)2^/^. U 
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Proposition 5 There exists a full-diversity binary code with uj* > 3 and R = 1/2— (1/A^)2 log2(A^/2+ 
!)• 

Proof: The code has the parity-check matrix of Fig. |4j The presence of a Hamming code 
whose minimum distance is 3 rules out a blockwise Hamming weight equal to 2. ■ 
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Fig. 4. ML-designed full-diversity LDPC code withco* > 3. 

We are now in a position to examine the word-error rate of full-diversity LDPC codes designed 
for ML decoding, and compare it to the outage capacity limit. The results are illustrated in 
Fig. |5} for ric = 2 and the (3, 6) ensemble using the constructions outlined above. With iterative 
decoding, an ML-designed LDPC code has diversity one. This effect is caused by the pseudo- 
codewords [12] whose support is restricted to Hi or H2, and hence have a minimum blockwise 
pseudo-weight equal to zero when iterative belief propagation decoding is applied. Even a random 
LDPC code (not shown in the figure) performs as poorly as an ML-designed code with = 1. 
On the other hand, full diversity is guaranteed when a "genie-aided" ML decoder is used which 
knows whether errors occur in positions corresponding to Hi or to H2. 



IV. Full-diversity LDPC codes for iterative belief propagation decoding 



The results presented at the end of Section III show that, if iterative decoding is used, the 
design criteria derived under the assumption of ML decoding are irrelevant. In this section, we 
proceed to design LDPC codes with the stipulation of iterative decoding. Our design is based 
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Fig. 5. Rate 1 /2 ML-designed LDPC codes with iterative decoding on a Rayleigh block-fading channel with Uc — 2. The thicis: 
solid line corresponds to the outage probability with BPSK inputs, the dotted lines with * markers corresponds to the ML-designed 
code with iterative decoding, the dotted lines with □ markers corresponds to the ML-designed code with uj* = 1 using a genie ML 
decoder and the dotted lines with + markers corresponds to the ML-designed code with cu* = 3 using the genie ML decoder The 
genie ML curves show the performance of a decoder that knows whether errors occur in positions corresponding to Hi or H2 ■ 



on a graphical representation [1], [20], which is then translated into a matrix description. We 
then analyze the construction by means of log-ratio probability-density evolution. 

A. A limiting case: block-erasure channels 

We illustrate our solution to the design problem by referring to a limiting case. Specifically, 
observe that, if the fading coefficients belong to the set {0, +oo}, the BF channel becomes a 
block-erasure channel [7], [13]. This corresponds to the large SNR regime. The reader is referred 
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to Fig. [6} where the outage boundaries are illustrated (see [4] for more details). 

In our approach, we need to find a graph whose topology yields full diversity. For simplicity, 
we illustrate the case of the (3, 6) LDPC ensemble with Uc = 2 (generalizations to other degree 
distributions and rates will be treated infra). Fig. |7] shows the notation employed in this section. 
Two examples of local graphs whose diversity is not guaranteed are shown in Fig. [8j The 
checknodes defining an LDPC code are single -parity check codes, and hence they cannot tolerate 
more than one erased bit. For example, if ai = then the checknodes in Fig. [8] are not able to 
recover the erased bit, because it is connected to bitnodes which are also erased, because they 
are subject to the same fading coefficient. Notice also that the design must be symmetric, i.e., 
any analysis with respect to ai is valid for 0:2, and hence permuting the order of the two fading 
gains should yield an equivalent design. 

The two unique local graphs that guarantee full diversity in the presence of block erasures 
are exhibited in Fig. [9} The immediate consequence is the definition of rootchecks. We start by 
building a regular (3, 6) structure where bitnodes have degree 3 and checknodes have degree 6, 
next we generalize to any (A(x),p(a;)) degree distribution [19]. A checknode $ connected to 




Fig. 6. Outage boundaries in the fading plane for a BF channel with Uc — 2. To approach the outage limit, one should: (a) Reduce 
the gap on the ergodic line, which requires an excellent decoding threshold, and (b) Reduce the gap at infinity, which requires a 
full-diversity code (MDS) on a block-erasure channel. 
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bits 'di, ■})2, ■ ■ ■ ,"^6 is written as ^^2, ■ ■ ■ , "^e)- 

Definition 2 Let d be a binary element transmitted on fading ai. A type-1 rootcheck for is a 
checknode $(^9, t^i, . . . , t^s) where all bits "^i, . . . are transmitted on fading a2- 

Type-2 rootchecks are defined similarly. 



O 



variable node on Oii 



{ ) variable node on «! connected to a rootcheck 



o 



variable node on 0^2 



variable node on CI2 connected to a rootcheck 



check node 



Fig. 7. Notations for graph representation. 

Using Definition [2} consider a length- A^, rate- 1/2 LDPC code. Information bits are split 
into two classes: N/A bits (tagged li) are transmitted on ai, while N/A bits (tagged 2i) are 
transmitted on 02- Parity bits are also partitioned into two sets, say Ip and 2p. Finally, we 
connect all information bits to rootchecks in order to guarantee full diversity when word error 
probability is measured on those bits. The protection of parity bits is abandoned. This design 



produces the bipartite Tanner graph drawn in Fig. 10(a) Its extension to rate 1/3 is portrayed in 



Fig. 11 Integers labeling edges indicate the degree of a node along those edges. The structure of 



H for a root-LDPC code is directly derived from its Tanner graph, and is shown in Fig. 1 10(b) 



The N/A X N/A identity matrix is written twice in connections li ^ Ic and 2i ^ 2c. Two 
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all-zero N/A x N/A submatrices prohibit any edge of type \p ^ Ic and 2p 2c. The other 4 
submatrices are all sparse, Hu and H2i are random sparse matrices of Hamming weight 2 per 
row and per column. Similarly, Hip and are random sparse matrices of Hamming weight 3 
per row and per column. 

An irregular version of a root-LDPC code can be built from a left degree distribution X{x) and 
a right degree distribution p{x) by appropriately modifying the weight distribution of the 4 sub- 
matrices Hu, H2i, Hip, and H2p. Equivalently, the degree distribution changes the distribution 
of edges connected to non-rootchecks in the Tanner graph, h-regularity has no influence on the 
diversity order because rootchecks are maintained. Irregularity should enhance the coding gain 
by pushing the code boundary near the outage capacity limit on the ergodic line. 
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(b) Parity-check matrix. 



Fig. 10. Tanner graph and parity-check matrix for a regular (3,6) root-LDPC code of rate 1/2. An irregular structure {X{x), p{x)) 
can be easily plugged on edges connected to non-root checknodes. 



Proposition 6 Consider a rate-R = 1/2 root-LDPC code with degree distribution {X{x),p{x)) 
transmitted on a block-erasure channel with ric = 2. Then, under iterative message passing 
decoding, the root-LDPC code has full-diversity. 

Proof: The two fading coefficients ai and a2 are independent and take two possible values 



{0,+oo}. Examining the Tanner graph of Fig. 10(a), we observe that the only outage event 
occurs when ai = 0:2 = (both blocks erased). Indeed, when ai = and 0:2 = +00, it is 
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Fig. 11. Tanner graph for a regular (4,6) root-LDPC code of rate 1/3. The introduction of any {X{x),p{x)) irregularity is 
always possible on edges connected to non-root checknodes. 

Straightforward to see that information bits li are determined using rootchecks Ic. Similarly, 
when ai = +00 and 0:2 = 0, information bits 2i are determined using rootchecks 2c. ■ 

On a block-erasure channel, let e be the probability that be equal to 0. From the proof 
of Proposition [6] above, we find that the word error probability of a root-LDPC code is e^. 
As shown in [7], this is precisely the outage probability of the channel, and therefore, full- 
diversity blockwise MDS codes are outage achieving in the block-erasure channel. As remarked 
in [7], blockwise MDS codes are necessary, but not sufficient to achieve the outage limit in 
noisy channels. In the following, we study the behavior of root-LDPC over general Rayleigh BF 
AWGN channels. 
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B. The general case 

Now we study the general case of Rayleigh BF. Some simple facts about 4th-order 
distributions are reviewed in the Appendix. In the sequel, we use the notations of the Appendix 
to analyze the diversity metric in log-ratio messages. 

Proposition 7 Consider a rate-1/2, (A(x),p(x)) root-LDPC code transmitted on a Rayleigh 
block-fading channel with ric = 2. Then, under iterative belief propagation decoding, the root- 
LDPC code has full-diversity. 

Proof: As indicated in the design of a root-LDPC code before Proposition |6| the diversity 
order of a root-LDPC code does not depend on its left or right degree distribution. This can also 
be proved via the evolution trees in the next section. Thus, we restrict this proof to a regular 
(3, 6) LDPC. The extension to the irregular case is straighforward. 

Let A", i = 1 ... 5 — 1, denote the input log-ratio probabilistic messages to a checknode $ of 
degree S. The output message A"^ for belief propagation is 



where th(x) denotes the hyperbohc-tangent function. Superscripts a and e stand for a priori 
and extrinsic, respectively. In order to simplify the proof, we will show that a suboptimal belief 
propagation decoder is able to achieve diversity order 2. Therefore, if a suboptimal decoder 
achieves full diversity, the optimal decoder also achieves full diversity. Consider the min-sum 
decoder. The output message produced by a checknode $ is now approximated by 



a) First decoding iteration: We first study the output after one decoding iteration. We 
assume that the all-zero codeword has been transmitted. The channel crossover probability 
associated with fading aj, j = 1,2, is 




(4) 



5-1 



= min 



(lA^I)nsign(An 



(5) 



1=1 



e, = Q (y^) 
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The channel message for a bit -d transmitted over fading coefficient a is 

where ?/ = a + 2; and z ~ A/'(0, cr^) (assuming = 1). At the first decoding iteration, all input 
messages A" in ([5]) have an expression identical to ([6]). 

An information bit i!) of class li has Aq = -^{^1 + aiZo). It also receives 3 messages Af, 
i = 1 . . .3 from its 3 neighboring checknodes. The total a posteriori message corresponding to 
'd is A = Aq + A^ + A2 + A|. Let A^ be the extrinsic message generated by the rootcheck of 
class Ic connected to The error rate Pe{li) on class li is given by the negative tail of the 
density of A messages. The addition of Ag + A3 to Aq + A^ cannot degrade PdU) because the 
convolution with the density of messages from non-rootchecks can only physically upgrade the 
resulting density. Thus, it is sufficient to prove that message Aq + A^ brings full diversity. The 
expression of Af is found by applying (j5]). Input messages to the rootcheck are negative with 
probability £2. Then 



2 



Ai = Si — {a2 + a2Zi] 



where 



We obtain 



i even ^ i odd ^ ' 



4-i 



Al = (l-2e2)'^(«2 + «2^i) 



The partial a posteriori log-ratio message becomes 

Ao + Al = ^ {al + (1 - 2e2)^«^) + a^zo + (1 - 262)^2^1) 

The embedded metric F = + (1 — 2e2)^ a"^ guarantees full diversity. At high SNR (i.e., when 
Eb/No — > +00), Y behaves exactly as aj + a^. 

b) Further decoding iterations: As can be seen from the decoding tree of a bitnode li in 



Fig. 14 the diversity order 2 is maintained after the first iteration. Indeed, at the input of the 
rootcheck, information bits of class 2i have already full diversity and parity bits 2p bring always 
a term proportional to a\. Due to the particular structure of root-LDPC codes, the density of 
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message Aq + can only be improved with respect to the first iteration. Hence, full diversity 
is preserved. ■ 

The proof of the previous proposition is based on showing that the information bits have 
diversity 2. In the following, we examine the diversity of the parity bits. A parity bit ^9 of class 
Ip has Ao = ^{al + aiZo). It also receives 3 messages A^, i = 1 . . . 3 from its 3 neighboring 
checknodes all of class 2c. The total a posteriori message of ^9 is A = Aq + A^ + A2 + A3. 
Now let us determine the nature of A,^ based on input messages to a checknode $ of class 2c 



as illustrated in Figures 10(a) and 15 The node $ is not a rootcheck. We need to determine the 
metric Y embedded in its output message. In the case «2 < ai (this happens with probability 
1/2), it can be shown that, after one decoding iteration, the extrinsic message produced by $ 
satsifies 



54 (ai + a2z) with probability > ^ 



S'4(af + o:iz) with probability 1 - < 



16 

16 



where the function G is defined in the Appendix. On the contrary, when a2 > ai, it can be 
shown that 

S^{al + a2z) with probability < ^ 



Af 



S\{al + aiz) with probability 1 - G'' > 



16 

We conclude that, for parity bits, with a probability greater than ^ x y|, the output message has 
diversity order one. In spite of the presence (with a nonzero probability) of diversity-2 messages, 
the error probability of parity bits will be dominated by weak messages with diversity 1. The 
above arguments are still valid for further decoding iterations. 

Finally, we look at the minimum partial Hamming weight uj* under belief propagation decod- 
ing. 

Corollary 1 A root-LDPC code with R= 1/2 has full-diversity under iterative belief propaga- 
tion decoding. 

Proof: Consider an information bit of class li. Let 5;, > 2 be the degree of ^. At high 
SNR, the log-ratio message produced by its rootcheck has an embedded metric a{ + a2- Consider 
the 5b — I non-root checknodes connected to ^. Since parity bits of class \p dominate the error 
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probability at the input of 2c checknodes, then its metric will be al- Finally, the a posteriori 
log-ratio message associated to i!) will contain a metric of the type 5f,af + which has diversity 
2. ■ 



In Fig. 12 we illustrate the performance of the (3,6) root-LDPC ensemble. As we observe, 
the performance is similar for all ranges of N, and it is also close to the outage probability of the 
channel. This effect was first observed with blockwise-concatenated codes and repeat- accumulate 
codes in [6], and then in [3]-[5] for parallel turbo codes. This effect is due to the threshold 
behavior of good codes, i.e., for a given channel realization, the code has a SNR threshold 
(independent of N) below which the decoder cannot decode successfully. Hence, whenever this 
threshold is larger than the SNR 7, the decoder will make an error for sufficiently large word 
length [6]. This is considered in more detail in the following section, where the analysis of the 
word error probability under iterative decoding for large N is done using density evolution. 

V. Density evolution in presence of block fading 

The evolution of message densities [18], [20] under iterative decoding is described through six 
evolution trees for a binary LDPC root-code. The evolution trees represent the local neighborhood 



of a bitnode in an infinite-length code whose graph has no cycles. Figs. 13, 14, and 15 show 
the local neighborhoods of classes li and Ip. Similar evolution trees can be drawn for classes 
2i and 2p. Full diversity in the presence of fading is guaranteed, thanks to messages Ic li 
(respectively, 2c 2i) as indicated in the proof of Proposition |7j L-regularity is defined in the 
standard way [19] through the polynomials \{x) and p{x). The polynomial \(x) is replaced 
by \(x) = \{x)/x each time an edge is isolated at the input of a bitnode. In addition, the 
polynomial p{x) is replaced by p{x) = p{x)/x each time an edge is isolated at the input of a 
checknode. The following notations are used, where the superscript m is an integer denoting the 
decoding iteration order: 

• q^{x) and Probability density functions of log-ratio messages on the edges li Ic 



and 2i 2c respectively. See Fig. 13 



/{"(x) and f^{x): Probability density functions of log-ratio messages on the edges li 2c 



and 2i —* Ic respectively. See Fig. 14 



g^{x) and g^{x): Probability density functions of log-ratio messages on the edges Ip 2c 
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Fig. 12. Regular (3,6) root-LDPC codes with iterative decoding on a Rayleigh hlock-fading channel with ric = 2. Word-error 
rate is measured on information bits. The thick solid line corresponds to the outage probability with BPSK, the dotted lines with 
X markers correspond to N = 200, the dotted lines with □ markers correspond to N = 2000 and the dotted lines with markers * 
correspond to N = 20000. 



and 2p — > Ic respectively. See Fig. 15 



• Let Xi ~ pi{x) and X2 ~ P2ix) be two independent real random variables. The den- 
sity function of Xi + X2 obtained by convolving the two original densities is written as 
Pi{x) ®p2{x). The notation p(x)'^" denotes the convolution of p{x) with itself n times. The 
expression \{p{x)) represents the density function Ylii 

• Let Xi ~ Pi{x) and X2 ~ P2{x) be two independent real random variables. The density 
function p(y) of the variable Y = 2 th^^(th(^) th(^)) obtained through a checknode is 
written as pi{x) Qp2ix) and is called R- convolution [20]. The notation denotes the 
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(S (b ® (S ^ ^ 

Fig. 13. Local neighborhood of bitnode li. This tree is used to determine the evolution of messages li —^ Ic. 

R-convolution of p{x) with itself n times. The expression p{p{x)) represents the density 
function J2i Pi p{x)'^'^~^. 

Proposition 8 Consider an (ergodic) AWGN channel (i.e., assume a\ — — 1). Under 
iterative decoding, a {X{x),p{x)) root-LDPC code has the same decoding threshold as a random 
{X{x),p{x)) LDPC code. 

Proof: With the two fading gains equal to unity, the six evolution trees degenerate into a 
single tree, and all densities become identical: q^{x) — q^{x) — f^{x) — f^{x) — g'^{x) — 
g^{x) for any decoding iteration m. Thus, density evolution of a root-LDPC code reduces to a 
classical density evolution of a random code given by = A(p(p"^(x))). ■ 

Proposition 9 Consider a nonergodic BF channel with ric = 2. For fixed fading coefficients 
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2c 

T" 




Fig. 14. Local neighborhood of bitnode li. This tree is used to determine the evolution of messages li 2c. 



(cKi, 0:2), the density evolution equations of a {X{x),p{x)) root-LDPC code are, for all m, 

q'^+'ix) = n,{x)^ X{qf{x)Qp{fefr{x)+ge9Tix))) 

fr^\x) = lii{x)®\{q^{x)QP{fefT{x)+g,gT{x)))®p{f,fr{x)+gegT{x)) 
g'^{x) — 

where the multi-edge type fraction is 

E.V(.-i) + E.A.A 

and iJ,i{x) is the Gaussian density at the output of the channel with fading ai. Similar density 
evolution equations are obtained by permuting the two fading gains. 

Proof: The above equations are directly derived from local neighborhoods of bitnodes in 
the graphical representation of the LDPC code, following standard density evolution analysis of 
multi-edge type LDPC codes [20]. ■ 
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2c 

"T" 




1 2 2 



© (!!) (i^ (ib 



Fig. 15. Local neighborhood of bitnode Ip. This tree is used to determine the evolution of messages Ip — > 2c. 



To evaluate the performance of LDPC codes via density evolution in presence of nonergodic 
fading, we illustrate the results obtained by applying Proposition |9] to the calculation of asymp- 
totic error probability of the code, in a similar way to what is done in [4] . Three codes are shown 



in Fig. 16 a random (3, 6) regular code, a root (3, 6) regular code, and an LDPC irregular root 



code with left and right degree distributions given by the polynomials [19] 

X{x) = 0.24426X + 0.25907a;2 + 0.01054x=^ + 0.05510x^ + 0.01455x^ + 0.01275a;^ + 0.40373x1^ 
and 

p{x) = 0.25475a;^ + 0.73438a;^ + 0.01087x1 

Refer again to the outage boundary representation in the fading plane of Fig. |6] Let be 
the fading value defined by the intersection of the BPSK outage boundary and the ergodic line. 
For rate 1/2, this intersection point satifies Ib{alEb/No) = 1/2, where Ib{x) = lAWGniRx) is 
the average mutual information on an AWGN channel with a binary input and an SNR per bit 
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Fig. 16. Density evolution of random-LDPC and root-LDPC codes with iterative decoding on a block-fading channel with ric — 2. 
The thick solid lines correspond to the outage probability with BPSK, the dotted lines with x markers correspond to the random 
LDPC, the dotted lines with □ markers correspond to the (3, 6) root LDPC and the dotted lines with * markers correspond to the 
irregular root LDPC ensemble. 



equal to x. 

Let ath denote the fading value defined by the intersection of the LDPC code outage boundary 
and the ergodic line. Then we have 







No 


th 
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where ^ 

"0 



is the decoding threshold of the LDPC code over the ergodic AWGN channel. 

th 



Finally, we obtain 

aov A 



ttth = ao' 







No 


th 




I) 



where A in the signal-to-noise ratio gap separating the decoding threshold and the capacity limit 



on the Gaussian channel. To better understand the gain due to irregularity illustrated in Fig. 16 
we evaluate the ratio ath/ao- 

• For the regular (3,6) LDPC code, the threshold is 1.09 dB above the Gaussian channel. 
Hence, Q;th/«o = 1-107. 

• For the irregular LDPC code given above, the threshold is 0.37dB above the Gaussian 
channel. Hence, ath/ao = 1-045. 

Using the best irregular code proposed in [19] with a threshold of 0.25 dB, we obtain «th/oo = 
1.007. Hence, with ac/^o close to 1, the area between the outage capacity boundary and the 
code outage boundary is decreased in the neighborhood of the ergodic line. However, this does 
not ensure that, the code outage boundary would be close to the outage capacity boundary in 
the critical region between the ergodic line and the block-erasure channel. Therefore, in order to 
approach the outage probability limit, a full-diversity capacity-achieving code is necessary, but 
may not be sufficient. 

VL Conclusions 

We have studied LDPC codes in the block-fading channel under both ML and iterative 
decoding. We have shown that constructions designed for ML decoders fail to guarantee diversity 
under iterative decoding. Driven by this restriction, we have introduced the new family of root- 
LDPC codes, which achieve full diversity under iterative decoding. We have shown both finite- 
and infinite-length performance, and we have illustrated how the error-rate performance of root- 
LDPC is close to the outage probability limit and almost insensitive to the block-length. This 
makes root-LDPC codes attractive for slowly-varying wireless communications scenarios. 
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Appendix I 

Coding gain of a 4th-order unbalanced distribution 

Here we limit our description to a diversity order of 2, but all results are easily extendable 
to rate-l/nc coding on a channel with diversity order ric. In the context of ML decoding, the 
Euclidean distance between two codewords is proportional to uial + uj2a2. As fading have 
a Rayleigh density, their squares are exponentially distributed, i.e., Pa^ix) = e~^. The latter is a 
central distribution of order 2 with parameter cr^ — 1/2 [17]. Diversity 2 is achieved with a 
X^ distribution of order 4. Hence, a full-diversity code must satisfy a;i > and a;i > in order 
to get the order-4, x^ distributed, metric uj-ia\ + a;2Q;|. Once maximum diversity is guaranteed, 
the maximization of the product ujiuJ2 increases the coding gain. 

The above simple facts are still valid in the context of iterative probabilistic decoding. Let 
A be the a posteriori probability log-ratio of a binary element h. Achieving full diversity under 
iterative decoding is equivalent to letting A behave as the metric Y = aa\ + 60:2, where a 
and h are two positive real numbers. The energy of Y is normalized, a -\-h — 1. The exact 
mathematical expression relating A to y depends on the type of iterative algorithm used for 
decoding, e.g., h. Y -\- v where v is an additive noise. To understand the influence of the 
product ah on the performance, one should study the error probability associated with Y, i.e. 
P(Y < T) = F{a,b,T). When a = 6 = 1/2, the order-4 x^ distribution is balanced, and its 
probability density function is 

PY{y) = Aye-^^ (7) 

When a 7^ 6 = 1 — a, the order-4 x^ distribution is unbalanced, and its probability density 
function is 

py{y) = ^ ' ^ (8) 

za — 1 

The expression of P{Y < T) = F{a,b,T) is obtained after integrating pviy)- The diversity 
order and the coding gain embedded in Y appear when T <^1. For a balanced x^ distribution, 
we have 

F(a,b,T) = l-e-2^(l + 2r) = 2T^ + o(T^) (9) 
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For an unbalanced distribution, we obtain 

T/a _ hp-T/h 

F{a,b,T) = 1- 



2a - 1 



2ab 



o(T2 



(10) 



In Fig. 17 , the performance function F{a, b, T) is plotted versus 7 = 1/T on a double logarithmic 



scale for different values of a and b. The slope is always 2 (i.e., F(a,b,T) oc 1/7^) for all 
positive values of a and b. The function F degenerates to T + o(T) when 6 = (diversity 
order equal to 1 instead of 2). Notice also that an unbalanced distribution with a = 3/4 and 
6=1/4 generates a coding loss about 0.65 dB. This loss is slightly higher (about 0.75 dB) when 
considering P(A < 0) for A cxY + v since additive noise depends on the fading coefficients as 
shown in Section |Wl 



V 




Fig. 17. Coding gain and diversity order ofY = aaf + ba2 (x^ of Ath order) where ai and ai are Rayleigh distributed. 
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Fig. 18. A 3D plot ofG = Pr(lX2 1 < \Xi\) versus ai and Q2 for a variance o"^ = 1 /lO. 



Appendix II 

The bidimensional cumulative density function G = Pr(|X2| < |Xi|) 

Consider two real independent Gaussian random variables Xi ~ J\f{al, afa'^) and X2 ~ 
7V(a2,"2^^)- We define the multivariate function ^(ai, ^2, o"^) = IP(|-^2| < The G 

function is given by the integral expression 

G = l- r -Ji==\e +e 1 [Q[^—Z±\+Q[^—^ \ 1 (H) 



2^2 




where Q{x) is the Gaussian tail function. A 3D plot of G is illustrated in Fig. 18 The main 
properties of G are: 
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. G{a,a,a^) = 1/2 for all > 0. 

• G is a non-decreasing function of Q!i and a decreasing function of a2. Hence, G < 1/2 if 
Oil < <^2 and G > 1/2 if q;2 < cti. 

• For fixed cr^ and q;2, G — > 1 as ai — > +oo. 

• For fixed cr^ and cci, G — > as a2 — > +oo. 
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